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Introduction 

That the moduH spaces of abehan varieties are a rich source of arithmetic and 
geometric information slowly emerged from the work of Kronecker, Klein, Frickc 
and many others at the end of the 19th century. Since the 20th century wc know 
that the first place to dig for these hidden treasures is the cohomology of these 
moduli spaces. 

In this survey we are concerned with the cohomology of the moduli space of 
abelian varieties. Since this is an extensive and widely ramified topic that connects 
to many branches of algebraic geometry and number theory we will have to limit 
ourselves. I have chosen to stick to the moduli spaces of principally polarized 
abelian varieties, leaving aside the moduli spaces of abelian varieties with non- 
principal polarizations and the other variations like the moduli spaces with extra 
structure (like conditions on their cndomorphism rings) since often the principles 
are the same, but the variations arc clad in heavy notation. 

The emphasis in this survey is on the tautological ring of the moduli space of 
principally polarized abelian varieties. We discuss the cycle classes of the Ekedahl- 
Oort stratification, that can be expressed in tautological classes, and discuss dif- 
ferential forms on the moduli space. We also discuss complete subvarieties of Ag. 
Finally, we discuss Siegel modular forms and its relations to the cohomology of 
these moduli spaces. We sketch the approach developed jointly with Faber and 
Bergstrom to calculate the traces of the Hecke operators by counting curves of 
genus < 3 over finite fields, an approach that opens a new window on Siegel mod- 
ular forms. 
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1. The Moduli Space of Principally Polarized Abelian Varieties 

We shall assume the existence of the moduli space of principally polarized 
abelian varieties as given. So throughout this survey Ag will denote the Deligne- 
Mumford stack of principally polarized abelian varieties of dimension g. It is a 
smooth Dcligne-Mumford stack over Spec(Z) of relative dimension g{g + l)/2, see 

m- 

Over the complex numbers this moduli space can be described as the arith- 
metic quotient (orbifold) Sp{2g,'Z)\Sjg of the Siegel upper half space by the sym- 
plectic group. This generalizes the well-known description of the moduli of complex 
elliptic curves as SL(2,Z)\i3 with Sj = S)i the usual upper half plane of the com- 
plex plane. We refer to Milne's account in this Handbook for the general theory 
of Shimura varieties. 

The stack Ag comes with a universal family of principally polarized abelian 
varieties tt : Xg ^ Ag. Since abelian varieties can degenerate the stack Ag is not 
proper or complete. 

The moduli space Ag admits several compactifications. The first one is the 
Satake compactification or Baily-Borel compactification. It is defined by consider- 
ing the vector space of Siegel modular forms of sufficiently high weight, by using 
these to map Ag to projective space and then by taking the closure of the image 
of Ag in the receiving projective space. This construction was first done by Sa- 
take and by Baily-Borel over the field of complex numbers, cf. [5]. The Satake 
compactification A* is very singular for g > 2. It has a stratification 

A*g=AgU A*g_l =AgU Ag-1 u • • • U U . 

In an attempt to construct non-singular compactifications of arithmetic quotients, 
such as Sp{2g,Z)\Sjg, Mumford with a team of co-workers created a theory of 
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so-called toroidal compactifications of Ag in [5] , cf. also the new edition [J] . These 
compactifications are not unique but depend on a choice of combinatorial data, 
an admissible cone decomposition of the cone of positive (semi)-definite symmet- 
ric bilinear forms in g variables. Each such toroidal compactification admits a 
morphism q : Ag — > A*g. Faltings and Chai showed how Mumford's theory of 
compactifying quotients of bounded symmetric domains could be used to extend 
this to a compactification of Ag over the integers, see [24l [25l [3] . This also led to 
the Satake compactification over the integers. 

There are a number of special choices for the cone decompositions, such as 
the second Voronoi decomposition, the central cone decomposition or the perfect 
cone decomposition. Each of these choices has its advantages and disadvantages. 
Moreover, Alexeev has constructed a functorial compactification of Ag, see [HIl]- 
It has as a disadvantage that for .g > 4 it is not irreducible but possesses extra 
components. The main component of this corresponds to A^°'^ , the toroidal com- 
pactification defined by the second Voronoi compactification. Olsson has adapted 
Alexeev's construction using log structures and obtained a functorial compactifi- 
cation. The normalization of this compactification is the compactification A^™, 

cf [SB. 

The toroidal compactification A^'^'^^ defined by the perfect cone decomposi- 
tion is a canonical model of Ag for g > 12 as was shown by Shcpherd-Barron, sec 
[69] and his contribution to this Handbook. 

The partial desingularization of the Satake compactification obtained by 
Igusa in [45| coincides with toroidal compactification corresponding to the central 
cone decomposition. We refer to a survey by Grushevsky ([SH]) on the geometry 
of the moduli space of abelian varieties. 

These compactifications (2nd Voronoi, central and perfect cone) agree for 
g < 3, but arc different for higher g. For g = 1 one has Ai = Al = Ali.i, the 
Deligne-Mumford moduli space of 1-pointed stable curves of genus 1. For g ~ 2 the 
Torelli morphism gives an identification A2 ~ M.2; the Deligne-Mumford moduli 
space of stable curves of genus 2. The open part A2 corresponds to stable curves 
of genus 2 of compact type. But please note that the Torelli morphism of stacks 
M.g — >■ Ag is a morphism of degree 2 for g > i, since every principally polarized 
abelian variety posseses an automorphism of order 2, but the generic curve of 
genus g > 3 does not. 

We shall use the term Faltings-Chai compactifications for the compactifica- 
tions (over rings of integers) defined by admissible cone decompositions. 

2. The Compact Dual 

The moduli space Ag{C) has the analytic description as Sp{2g,Z)\S)g. The 
Siegel upper half space Sjg can be realized in various ways, one of which is as an 
open subset of the so-called compact dual and the arithmetic quotient inherits 
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various properties from this compact quotient. For this reason we first treat the 
compact dual at some length. 

To construct S)g, we start with an non-degenerate symplectic form on a com- 
plex vector space, necessarily of even dimension, say 217. To be explicit, consider 
the vector space Q^^ with basis ei,...,e2g and symplectic form (, ) given by 
J{x, y) = Jy with 



where rj : G ^ Gm is the so-called multiplyer. Then G is the group of matrices 
7 = {AB;CD) with A, B, G, D integral g x g-matrices with 



that parametrizes all totally isotropic subspaces of our complex symplectic vector 
space. This is a homogeneous manifold of complex dimension g{g + l)/2 for the 
action of G(C) = GSp(2g, C); in fact this group acts transitively and the quotient 
of GSp(2g, C) by the central Gi„(C) acts effectively. We can write Yg as a quotient 
Yg = G{C)/Q, where Q is a parabolic subgroup of G(C). More precisely, if we fix a 
point yo = ei A. . .Acg G Yg then we can write Q as the group of matrices {A B; G D) 
in GSp(2(7, C)} with C = 0. This parabolic group Q has a Levi decomposition as 
Q = M X U with M the subgroup of G that respects the decomposition of the 
symplectic space as © Q^; the matrices of M are of the form {AO; D) and is 
isomorphic to GL{g) x <Gm, while those of U are of the form (Ig B; Ig) with B 
symmetric. 

There is an embedding of Sjg into Yg as follows. We consider the group G°(]R) 
and the maximal compact subgroup K of elements that fix ^/—l Ig. Its elements 
are described as {A — B;B A) and assigning to it the element A + \/~lB gives an 
isomorphism of K with the unitary group U{g). One way to describe the Siegel 
upper half space is as the orbit Xg = G^{M.)/K under the action of G°; this can 
be embedded in Yg = {G/Q){C) as the set of all maximal isotropic subspaces V 
such that —\/~l{v, v) is positive definite on V. Each such subspace has a basis 
consisting of the columns of the transpose of the matrix (— Igr) for a unique 
T G Sjg. The subgroup G"''(M) leaves this subset invariant and this establishes the 
embedding of the domain ^g in its Yg and this space Yg is called the compact dual 




We let G = GSp(2gi, Q) be the algebraic group over Q of symplectic similitudes of 
this symplectic vector space 



G = {ge GL(2<7, Q) : J{gx, gy) = r]{g)J{x, y)} , 



A^ -G = C* ■ A, B* ■ D ^ D* ■ B and A* • £> - G* • B = Tj{g)l 

We denote the kernel of 77 by G'^. 

Let Yg be the Lagrangian Grassmannian 

= {L C : dim(L) g, J{x, y) = for aU x,y e L} 
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of f^g. It contains Xg ~ Sjg as an open subset. The standard example (for g — I) 
is that of the upper half plane contained in . 

For later use we extend this a bit by looking not only at maximal isotropic 
subspaces, but also at symplectic filtrations on our standard symplectic space. 

Consider for i ~ l,...,g the (partial) flag variety Ug^^ of symplectic flags 
Ei d . . . d Eg^i C Eg, of hnear subspaces Ej of C^^ with dim{Ej) = j and Eg 
totally isotropic. We have J/g^' = Yg. There are natural maps tt^ : J/g'"* — > C/g*^^' 
and the fibre of tt^ is a Grassmann variety of dimension i. We can represent Ug^"^ 
as a quotient G/B, where i? is a Borel subgroup of G. These spaces L^''' come 
equipped with universal flags Ei C E'i+i d . . . <Z Eg. 

The manifold Yg possesses, as all Grassmannians do, a cell decomposition. 
To define it, choose a fixed isotropic flag {0} = 2'o C Zi C Z2 C . . . C Zg\ that is, 
dim Zi = i and Zg is an isotropic subspace of our symplectic space. We extend the 
filtration by setting Zgj^i = [Zg^i)^ for z = 1, . . . , g. For general V £ Yg we expect 
that V n Zj = {0} for j < g. Therefore, for fi — {fii, . . . , fir) with fii non-negative 
integers satisfying 

< Ml < 5> A^i - 1 < Mi+i < (1) 

we put 

W^ = {VeYg: dim(V^ n = i} . 

This gives a cell decomposition with cells only in even real dimension. The cell 
has (complex) codimension ^ fii. Denote the set of n-tuples fi = {pi, . . . , fig) 
satisfying (1) by Mg. Then #Mg = 2^. Moreover, we have 

C fii>Vi for I <i < g ■ 

From the cell decomposition we find the homology of Yg. 

Proposition 2.1. The integral homology oj Yg is generated by the cycle classes 
of [W ^] of the closed cells with fi S Mg. The Poincare-polynomial of Yg is given 

byEb2^t' = (l+t)(l+t2)...(l+t9). 

Note that Yg is a rational variety and that the Chow ring Rg of Yg is the 
isomorphic image of the cohomology ring of Yg under the usual cycle class map. 
On Yg we have a sequence of tautological vector bundles 0— >iJ— >Q— >0, 
where H is the trivial bundle of rank 2g defined by our fixed symplectic space 
and where the fibre of Ey of E over y is the isotropic subspace of dimension g 
corresponding to y. The bundle E corresponds to the standard representation 
of if = U{g), see also Section [3l The tangent space to a point e = [E] of Yg 
is Hom^^"^ {E , Q) , the space of symmetric homomorphisms from E to Q; indeed, 
usually the tangent space of a Grassmannian is described as Hom(i?,Q) ("move 
E a bit and it moves infinitesimally out of the kernel of ii ^ Q"), but we have to 
preserve the symplectic form that identifies E with the dual of Q; therefore we have 
to take the 'symmetric' homomorphisms. We can identify this with Sym^(i?^). 
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Wc consider the Chcrn classes Ui = Ci{E) G Rg ^ CH*{Yg) ior i — 1, . . . , g. 
Wc call them tautological classes. The symplectic form J on H can be used to 
identify E with the dual of the quotient bundle Q . The triviality of the bundle 
H implies the following relation for the Chern classes of E in Rg-. 

(1 + Ul + U2 + . . . + Ug){l -UI+U2 + ... + (-l)^Ug) = 1 ■ 

These relations may be succinctly stated as 

ch2fe(^) = (fc>l), (2) 
where ch2fc is the part of degree 2k of the Chcrn character. 

Proposition 2.2. The Chow ring Rg of Yg is the ring generated by the Ui with 
as only relations ch2fe (E) = for k > I. 

One can check algebraically that the ring which is the quotient of Z[ui , . . . , Ug] 
by the relation (2) has Betti numbers as given in Prop. l^T] This description implies 
that this ring after tensoring with Q is in fact generated by the Uj with j odd. 
Furthermore, by using induction one obtains the relations 

UgUg^i ■ ■ ■ Uk+iuf. = for fc = g, . . . , 1. (3) 

It follows that this ring has the following set of 2^ basis elements 

Y[u,, /C {!,..., .g}. 

The ring Rg is a so-called Gorenstein ring with socle UgUg-i ■ ■ ■ ui. 
Using Rg/{ug) = Rg-i one finds the following properties. 

Lemma 2.3. In Rgl{ug) we have uf^~^^'^ ^ and uf^'^^'^^^ ^ 0. 

Define now classes in the Chow ring of the flag spaces Ug'^ as follows: 
Vj^c,{E^/E^_,) eCH*{U^''>) j=i,...,g. 

Moreover, we set 

uf=Cj{E,) eCi/*(C/f) J = !,...,*. 

(i) 

We can view as the jth symmetric function in vi, . . . ,Vi. Then we have the 
relations under the forgetful maps Wi : Uy ^ Ug 

<(4^+^') = M« 1 J = + (4) 

and 

f j - u['\f^ + ... + (-l)^Mf =0 J = 1, . . . , 5. (5) 
The Chow ring of C/g^' has generators 

vTvT---v-^u'g^u';-l---ui^ 

with < rji < i and e; = or 1. 
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Lemma 2.4. The following Gysin formulas hold: 

(1) (7r0*(c) = for all c G CH*[ul'^^^); 

(2) = 1; 

(3) ) = (-!)'. 

These formulas together with (4) and (5) completely determine the image of 
the Gysin map (tt)* = • • • tti)*. 



For a sequence of r < g positive integers /x^ with /i^ > ^i+i we define an 
element of Rg-. 

A^(m) = det (^(Up,-j+j)l<i<r;l<i<r) ■ 

Wc also define so-called Q-polynomials by the formula: 

Qi,j = UiUj - 2ui+iUj_i + . . . + {-iy2ui+j for i < j. 

Wc have Q^o ~ '^i for * — li ■ • ■ > 5- Let /i be a strict partition. For r even we define 
an anti-symmetric matrix [x^] = [xij] as follows. Let 

a^ij- = Q^^.^^j (") foi' 1 < * < j < 

We then set for even r 

s^ = pf(M), 

while for r odd we define = S^j^...y^^o- These expressions may look a bit artifi- 
cial, but their purpose is clearly demonstrated by the following Theorem, due to 
Pragacz [66 1 131]. 

Theorem 2.5. (Pragacz's formula) The class of the cycle [W ^] in the Chow ring 
is given by (a multiple of) 

From (2.4) we have the property: for partitions /x and v with A** + S = 
g{g + l)/2 we have 

[0 if i^T^p- pi, 

where p = {g, g — 1, . . . ,1}. We have the following relations in CH*{Yg): 

i) UgUg-l . . .Ul = 1, 

where 1 represents the class of a point and N = g{g + l)/2. 
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Proof. For i) We have Ty^ ^ Syni^(£^^), thus the Chern classes of the tangent 
bundle Ty^ are expressed in the Ui. By [29], Ex. 14.5.1, p. 265) for the top Chern 
class of Sym^ of a vector bundle we have 



<Y9 



23 = 23 A 



(u) 23 det 



. 

Ug-2 Ug-1 Ug . 



UiJ 



Developing the determinant gives 



1 = UgUg-^l . . .Ul+ UgA{u) + UgUg_^B{u) + . . . , 

from which the desired identity results by using (3). Alternatively, one may use 
Pragacz's formula above for the degeneracy locus given hy Zg = V for some 
subspace V. □ 



3. The Hodge Bundle 

Since Ag comes with a universal principally polarized abelian variety tt : 
Xg — > Ag we have a rank g vector bundle or locally free sheaf 

E = Eg = n4n],j_^^), 

called the Hodge Bundle. It has an alternative definition as 

i.e., as the cotangent bundle to the zero section s : Ag Xg. If X^ is the dual 
abelian variety (isomorphic to Xg because we stick to a principal polarization) 
then the Hodge bundle E* of X^ satisfies 

{¥}Y ^Ue{Xl)'^R^T:,Ox,. 

The Hodge bundle E can be extended to any toroidal compactification Ag of 
Faltings-Chai type. In fact, over Ag we have a universal family of semi-abelian 
varieties and one takes the dual of Lie(<Y), cf. [3S]. We shall denote it again by E. 

If we now go to a fine moduli space, say Ag [n] with n > 3, the moduli space of 
principally polarized abelian varieties with a level n structure, and take a smooth 
toroidal compactification then we can describe the sheaf of holomorphic 1-forms 
in terms of the Hodge bundle. With D = Ag[n] — Ag[n], the divisor at infinity, we 
have the important result: 

Proposition 3.1. The Hodge bundle E on Ag[n] for n > 3 satisfies the identity 

Sym2(E)-r!i^^j^j(logZ?). 
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This result extends the description of the tangent space to f)g in the compact 
duaL It is proven in the general setting in [25j . p. 86. 

Recall the description of Yg as the symplectic Grassmannian G(C) /Q(C) with 
G = GSp(2g, Z) and Q the parabohc subgroup with Levi decomposition M k U 
with M = GL(g) x Gm- The Siegel upper half space fjg can be viewed as an 
open subset of Yg. Put Go = Sp(2g,Z), Qo = Q n Go and AIq = A/ n Gq. Then 
if p : Qo — >■ GL(y) is a finite-dimensional complex representation, we define an 
equivariant vector bundle Vp on Yg by 

Vp = Go(C) xQ°(^) V, 

where the contracted product is defined by the usual equivalence relation {g, v) ^ 
{gq, p{q)~^v) for all g S Go(C) and q £ Qo{C). Then our group Sp{2g,Z) acts 
on the bundle Vp and the quotient is a vector bundle Vp in the orbifold sense on 
Ag{C)^Sp{2g,I.)\^g. 

A representation of GL(g) can be lifted to a representation of Qo by letting it 
act trivially on the unipotent radical U of Mq. Carrying out this construction with 
the standard (tautological) representation of GL{g) produces the Hodge bundle. 

The Hodge bundle can be extended to a bundle over our toroidal compactifi- 
cation Ag. Since any bundle Vp is obtained by applying Schur functors to powers 
of the Hodge bundle (see [3D]) we can extend the bundle Vp by applying the Schur 
functor to the extended power of the Hodge bundle. In this way we obtain a 
canonical extension to Ag for all equivariant holomorphic bundles Vp. 

4. The Tautological Ring of Ag 

The moduli space Ag is a Deligne-Mumford stack or orbifold and as such 
it has a Chow ring. To be precise, consider the moduli space Ag <Si k over an 
algebraically closed field k. For simplicity we shall write Ag instead. 

We are interested in the Chow rings Cii{Ag) and CIiQ{Ag) of this moduh 
space. In general these rings seems unattainable. However, they contain subrings 
that we can describe well and that play an important role. 

We denote the Chern classes of the Hodge bundle by 

:= Ci(E), i = l,...,g. 

We define the tautological subring of the Chow ring CllQ{Ag) as the subring 
generated by the Chern classes of the Hodge bundle E. 

The main result is a description of the tautological ring in terms of the Chow 
ring Rg-i of the compact dual Yg^i (see [5^). 

Theorem 4.1. The tautological subring Tg of the Chow ring Cilq{Ag) generated 
by the Xi is isomorphic to the ring Rg-i- 
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This imphes that a basis of the codimension i part is given by the monomials 

9-1 

A? A^r/ e, e {0, 1} and ^ j e, = z. 

This theorem follows from the following four results, each interesting in its own 
right. 

Theorem 4.2. The Chern classes Xi of the Hodge bundle E satisfy the relation 

(1 + Ai + • • • + Ag)(l - Ai + • • • + i-iyXg) = 1. 

Theorem 4.3. The top Chern class \g of the Hodge bundle E vanishes in CHQ(^g). 

Theorem 4.4. The first Chern class Ai o/E is ample on Ag. 

Theorem 4.5. In characteristic p > the moduli space Ag <Si Ep contains a 
complete subvariety of codimension g. 

To deduce Theorem 14. II from Thms lT^ - l4.5l we argue as follows. By Theorem 
14.21 the tautological subring Tg is a quotient ring of Rg via Ui i— >■ Xi, and then 
by Theorem 14.31 also of Rg-i = Rg/{ug). The ring Rg~i is a Gorenstein ring 
with socle uiU2 ■ ■ ■ Ug-i and this is a non-zero multiple of m^'^ _ gy Theorem 
14.41 the ample class Ai satisfies X\ ■ [V] ^ on any complete subvariety V of 
codimension j in Ag. The existence of a complete subvariety of codimension g 
in positive characteristic implies that A^*-^"^-*^^ does not vanish in CHQ(^g i^iEp), 
hence the class A^*-^ ^■'^^ docs not vanish in Cllq{Ag). If the map Tg — >■ Rg-i 
defined by A^ i~> Ui would have a non-trivial kernel then A^*-^ ^^^'^ would have to 
vanish. 

Theorem 14.21 was proved in [32] . The proof is obtained by applying the 
Grothendieck-Riemann-Roch formula to the theta divisor on the universal abelian 
variety Xg over Ag. In fact, take a line bundle L on Xg that provides on each fibre 
X a theta divisor and normalize L such that it vanishes on the zero section of Xg 
over Ag. Then the Grothendieck-Riemann-Roch Theorem tells us that 

ch(^,L) = ^,(ch(L).Td^(l]^^/^J) 

= ^,(ch(L).Td^(7r*(E<,))) (1) 

= 7r4cli(L))-Td''(E), 

where we used = 7r*(E) and the projection formula. Here Td^ is defined 

for a line bundle with first Chern class 7 by ^jie^ ~ !)■ But R^TTi,L = for our 
relatively ample L for i > and so ■k\L is represented by a vector bundle, and 
because L defines a principal polarization, by a line bundle. We write 6 = ci{t:\L). 
This gives the identity 

fc=0 k=0 ' 
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Recall that Td'^(E) = 1 - Ai/2 + (A? + A2)/12 + . . .. We can compare terms of 
equal codimension; the codimension 1 term gives 

(? = -Ai/2 + 7r,(e3+V(.g + l)!). (3) 

If we now look how both sides of (2) behave when we replace L by L", we see 
immediately that the term Q9+^ of the right hand side changes by a factor n^^^ . 
As to the left hand side, for a principally polarized abelian variety X the space 
of sections H^{X, Lf^) is a representation of the Heisenberg group; it is the irre- 
ducible representation of degree nP . This implies that ch(7r!L) = n^ch(7r!L). We 
see 

fc=0 \A:=0 ' I 

Comparing the coefhcients leads immediately to the following result. 
Corollary 4.6. In G^q{Ag) we have 7r,(ch(L)) = 1 and ch(7r,i) = Td^(E). 

In particular tt, (8^+^) = 0. Substituting this in (3) gives the following result. 
Corollary 4.7. (Key Formula) We have 26 = — Ai. 
Corollary 4.8. We have ch2A;(E) = for k>l. 
Proof. The relation (1) reduces now to 

g-Ai/2 ^ xd''(E). 

If, say pi, . . . ,pg are the Chern roots of E, so that our A^ is the ith elementary 
symmetric function in the pj , then this relation is 

i=i 

This is equivalent with ch2fc(E) = for fc > and also with Td(E ® E^) = 0. □ 

The proof of Theorem 14.31 is also an application of Grothendieck-Riemann- 
Roch, this time applied to the structure sheaf (i.e., n = in the preceding case). 
We find 

ch{7T,OxJ = Mch{OxJ ■ Td^7r*(E3)) = 7r,(l)Td^(E3) = 0. 

For an abelian variety X the cohomology group H^{X,Ox) is the ith exterior 
power of H^{X, Ox) and we thus see that the left hand side equals (global Serre 
duality) 

ch(l - E"" + A^E"" + {-ly A» E""). 

But by some general yoga (see |10| ) we have for a vector bundle B of rank r the re- 
lation Ei=o(-l)^ch(AJ.B^) = CriB)Td{B)-\ So the left hand side is Ag Td(E)~i 
and since Td(E) starts with 1 + . . . it follows that Ag is zero. 
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Theorem 14.41 is a classical result in characteric zero. If we present our mod- 
uli space Ag over C as the quotient space Sp(25,Z)\j0g then the determinant of 
the Hodge bundle is a (n orbifold) line bundle that corresponds to the factor of 
automorphy 



In other words, a section of the kth power of det(E) gives by pull back to Sjg a 
holomorphic function / : f^g — > C with the property that 



A very well-known theorem by Baily and Borel (see [5]) says that modular forms 
of sufficiently high weight k define an embedding of Sp(2g, Z)\i3g into projective 
space. The idea is that one can construct sufficiently many modular forms to 
separate points and tangent vectors on ^^(C). So Ai is an ample class. Clearly 
this holds then also in characteristic p if p is sufficiently large. So if we have a 
complete subvariety of of codimension j in Ag <Si Fp for every p then X\ cannot 
vanish when restricted to this subvariety. 

Theorem 14.41 was extended to all characteristics by Moret-Bailly, see [55] . 

5. The Tautological Ring of Ag 

In this section, just as in the preceding one, we will write Ag for Ag (8) k with 
k an algebraically closed field. 

The class Ag vanishes in the rational Chow ring of Ag. However, in a suitable 
compactification of Ag this is no longer true and instead of the quotient Rg-i = 
Rg/{ug) we find a copy of Rg in the Chow ring of such a compactification. 

We consider a smooth toroidal compactification Ag of Ag of the type con- 
structed by Faltings and Chai. Over Ag we have a 'universal' semi-abelian variety 
Q with a zero-section s, see (25| . Then s*hic{Q) defines in a canonical way an 
extension of the Hodge bundle E on Ag to a vector bundle Ag. We will denote 
this extension again by E. 

The relation (1) of the preceding section can now be extended to Ag. A proof 
of this extension was given by Esnault and Viehweg, see [H]. They show that in 
characteristic for the Deligne extension of the cohomology sheaf with its 
Gauss-Manin connection the Chern character vanishes in degree ^ by applying 
Grothcndicck-Riemann-Roch to a log extension and using the action of —1 to 
separate weights. By specializing one finds the following result. 

Theorem 5.1. The Chern classes Xi of the Hodge bundle E on Ag satisfy the 



det (cT + d) 




/((ar 4- b){cT + d)-^) = det(cT + 



relation 



(1 + Ai + • • • + Ag)(l - Ai + • • • + i-iyXg) = 1. 



This implies the following result: 
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Theorem 5.2. The tautological subring Tg of CVi^{Ag) is isomorphic to Rg 

Proof. Clearly, by the relation of 15. II the tautological ring is a quotient of Rg-, since 
Ai is ample on an open dense part {Ag) the socle 

does not vanish, and the tautological ring must be isomorphic to Rg. □ 

The Satake compactification A* of Ag, defined in general as the proj of the 
ring of Siegel modular forms, possesses a stratification 

A*g^AgU Ag-1 u---uAiUAo. 

By the natural map q : Ag — > A*g this induces a stratification of Agi we let A^g"^ be 
the inverse image q~^{Ag U Ag-i U • • • Ag-t), the moduli space of abelian varieties 
of torus rank < t. We have the following extension of Theorems 14.31 and 14.51 

Theorem 5.3. For t < g we have the relation \gXg_i ■ ■ ■ Xg-t — in the Chow 
group CHq (^g*') with m — X]i=o 5 ~ 

Theorem 5.4. The moduli space A^g'^ ® Fp in characteristic p > contains a 
complete subvariety of codimension g — t, namely the locus of abelian varieties of 
p-rank < t. 

Corollary 5.5. We have A^^f'^^/^+t _^ q on A^g\ 

Proposition 5.6. For < k < g and r > we have on the boundary Al. C A* of 
the Satake compactification 

This follows from the fact that Ai is an ample class on A*g, that Ai|^^. is 
again Ai (now of course defined on Al) and the fact that dim^^ = k{k + l)/2. 

6. The Proportionality Principle 

The result on the tautological ring has the following immediate corollary, a 
special case of the so-called Proportionality Principle of Hirzebruch-Mumford: 

Theorem 6.1. The characteristic numbers of the Hodge bundle are proportional 
to those of the tautological bundle on the 'compact dual' Ygi 

Ar • • • ([AD - (-1)^^^+'^/'^ C(l - 2fc)^ -uT--- {[Yg]) 
for all (rii, . . . , rig) with "Y^Ui ~ g{g + l)/2. 



A? 



;?(;?+i)/2 
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Indeed, any top-dimensional class A"^ • • • Ag" is a multiple ni{ni, . . . ,ng) 
times the top-dimensional class Xi ■ ■ ■ Xg where the coefficient depends only on 
the structure of Rg. So the proportionality principle is clear, and to make it ex- 
plicit one must find the value of one top-dimensional class, say Ai • • • Ag on Ag. 
The top Chern class of the bundle Sym^ (E) on Ag equals 

2^ Ai • • • Ag . 

We can interpret 2^ dcg(Ai • • • Ag) up to a sign (—1)9(9+1)/^ as the log version of 
the Euler number of Ag. It is known via the work of Siegel and Harder: 

Theorem 6.2. (Siegel-Harder) The Euler number of Ag is equal to 

C(-l)C(-3)...C(l-2.g). 

Example 6.3. For g ~ I the Euler number of .4i(C) is —1/12. It is obtained by 
integrating 

, . 1 dx A dy 

over the usual fundamental domain ({r — x + iy E : \x\ < 1/2, a;^ + y^ > 1}) 
for the action of SL(2,Z) and (which gives 2({—l) = —1/6) and then dividing by 
2 since the group SL(2,Z) does not act effectively (—1 acts trivially). 

The Proportionality Principle immediately extends to our equivariant bun- 
dles Vp since these are obtained by applying Schur functors to powers of the Hodge 
bundle. 

Corollary 6.4. (The Proportionality Principle of Hirzebruch-Mumford) The char- 
acteristic numbers of the equivariant vector bundle Vp on Ag are proportional to 
those of the corresponding bundle on the compact dual Yg 

The proportionality factor here is 
We give a few values. 



9 


1 


2 


3 


4 


5 




24 


5760 


2903040 


1393459200 


367873228800 



A remark about the history of this 'principle'. Hirzebruch, inspired by a 
paper of Igusa, found in 1958 (see (IJ) that for a discrete torsion- free group F of 
automorphisms of a bounded symmetric domain D such that the quotient Xr = 
T\D is compact, the Chern numbers of the quotient are proportional to the Chern 
numbers of the compact dual D of D. In the case of a subgroup F C Sp(2g,M) 
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that acts freely on Sjg this means that there is a proportionahty factor er such 
that for all n = (ni, . . . , ?T.g(g-|-i)/2) with rii e Z>o and '^rii — g{g + l)/2 we have 

c"(Xr) = erc"(yg), 

where c" stands for the top Chern class J|,- c"' and Yg is the compact dual of 
^g. His argument was that the top Chern classes of X are represented by G'(K)- 
invariant differential forms of top degree and these are proportional to each other 
on D and on D. The principle extends to all equivariant holomorphic vector 
bundles on Sjg. Mumford has obtained (see |58| ) an extension of Hirzebruch's 
Proportionality Principle that applies to his toroidal compactifications of Ag . 

7. The Chow Rings of Ag for 5 = 1, 2, 3 

For low values of g the Chow rings of Ag and their toroidal compactifications 
can be explicitly described. 

Theorem 7.1. The Chow ring CHq(^i) is isomorphic to Q[Ai]/(Af). 

Mumford determined in [S5] the Chow ring of A2 ■ 

Theorem 7.2. The Chow ring CilQ{A2) is generated by Xi, A2 and ai and iso- 
morphic to Q[Ai, A2, cri]/(/2), with I2 the ideal generated by 

(1 + Ai +A2)(1 - Ai +A2) - 1, A2CT1, al - 22Xiai + 120X1 

The ranks of the Chow groups are 1, 2, 2, 1. 

The intersection numbers in this ring are given by 



2\1 


Ai 


0-1 


A? 
Aio-i 


1/2880 





-1/24 



while the degrees of the top classes in the sigmas are 

deg(a3) = 1/4, deg(a2ai) = -1/4, deg(a?) = -11/12. 
For genus 3 the result is (cf. [33]): 

Theorem 7.3. The tautological ring of A3 is generated by the Chern classes Xi 
and isomorphic to Q[Xi]/{Xf). 

Theorem 7.4. The Chow ring CHq(^3) of A3 is generated by the Xi, i = 1,2,3 
and the ai, i = 1,2 and is isomorphic to the graded ring (subscript is degree) 

Q[Al,A2, A3,cri,(T2]/-^3, 
with I3 the ideal generated by the relations 

(1 + Ai + A2 + A3)(l - Ai + A2 - A3) = 1, 
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AafTi = A30-2 = Ai(T2 = 0, 

o n 11 

erf = 2016 A3 - 4 XfcTi - 24 Aicr2 + ^ cr2cri, 
CT2 = 360 Ajcri - 45 Xjal + 15 Aicr2cri, 
(Tf(T2 = lG8GA?cri - 165A?crJ +47Aicr2Cri. 



The ranks of the Chow groups are: 1,2,4,6,4,2,1. 

For the degrees of the top dimensional elements we refer to [33]. 

8. Some Intersection Numbers 

As stated in section [1] the various compactifications employed for Ag each 
have their own merits. For example, the toroidal compactification associated to the 
perfect cone decomposition has the advantage that its boundary is an irreducible 
divisor D = Dg. 

By a result of Borcl it is known that in degrees < g — 2 the cohomology 
of Sp{2g, Q) (and in fact for any finite index subgroup F) is generated by elements 
in degree 2A: + 4 for fc = 0, 1, . . . , (g - 6)/2: 



In particular in degree 2 there is one generator. We deduce (at least for g > 6 and 
with special arguments also for 2 < g < 5): 

Proposition 8.1. The Picard group of Ag for g >2 is generated by the determi- 
nant Ai of the Hodge bundle. 

By observing that on Ag^'' and A^'^'^^ the boundary divisor is irreducible we 

get: 

Corollary 8.2. The Picard group of A^g^ and o/yl^"'^ is generated by Ai and the 
class of D. 

It would be nice to know the top intersection numbers A"£''-^~" with G = 
g{g + l)/2 = dim^g. It seems that these numbers are zero when n is not of the 
form k{k + l)/2. In fact, Erdenberger, Grushcvsky and Hulek formulated this as 
a conjecture, see [20] . 

Conjecture 8.3. The intersection number degXi D'^~" on A^°'^^ vanishes unless 
n is of the form n ~ k(k + l)/2 for k < g. 

From our results above it follows that 



degAf = (-l)«gn 



C(l - 2fc) 
(2fc- 1)!! ■ 



fc=i 
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Erdenberger, Grushevsky and Hulek calculated the next two cases. We quote only 
the first 

and we refer for the intersection number deg A'-^^^''^ ^^•'/■^Z?^^^^ to loc. cit. 

9. The Top Class of the Hodge Bundle 

As before, we shall write here Ag for Ag (E) k with k an algebraically closed 

field. 

The cycle class Ag vanishes in GViq{Ag). However, it does not vanish on 
dl^{Ag), for example because A1A2 • • • Ag is a non-zero multiple of A^ that 
has positive degree since Ai is ample on Ag. This raises two questions. First, what 
is the order of Ag in CH^(^g) as a torsion class? Second, since up to torsion Ag 
comes from the boundary Ag — Ag , one can ask for a natural supporting cycle for 
this class in the boundary. Since we work on stacks one has to use intersection 
theory on stacks; the theory is still in its infancy, but we use Kresch's approach 
[5U] . Mumford answered the first question for g = 1 in [35] ■ 

In joint work with Ekedahl (' jl7l [T5] ) we considered these two questions. Let 
us begin with the torsion order of Ag in CH^(^g). A well-known formula of Borel 
and Serre (used above in Section[3]) says that the Chern character of the alternating 
sum of the exterior powers of the Hodge bundle satisfies 

ch(A*E) = (-l)9AgTd(E)-i 

and this implies that its terms of degree !,...,(;— 1 vanish and that it equals 
-(.g - l)!Ag in degree g. 

Lemma 9.1. Let p be a prime and tt : A ^ S be a family of abelian varieties of 
relative dimension g and L a line bundle on A that is of order p on all fibres ofir. 
If p > min(2g, dimS" + g) then p (g — l)!Ag = 0. 

Indeed, we may assume after twisting by a pull back from the base S that 
LP is trivial. Let [L] be its class in Ka{A). Then 

0^[Lr-l = {[L]-ir+p{[L]-l){l + P^i[L]-l) + ...). 

Now [L] — 1 is nilpotent because it has support of codimension > 1 and so it follows 
that p {[L] — 1) lies in the ideal generated by {[L] — 1)^ which has codimension > p. 
Now if p > 2(7 or p > dim S + g the codimension is > 2(7, hence the image under tt 
has codimension > (7 or is zero. We thus can safely remove it and may assume that 
p[L] = p in Ko{A). Consider now the Poincarc bundle P on Ax A; wc know that 
H^(X X P) for an abelian variety X is zero for i ^ (7 and 1-dimensional for i ~ g. 
So the derived pullback of i?7r,P along the zero section oi Ax A over A is Rtt^,Oa- 
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We know that p [P] = p[L (g) P] and p [Rn^P] = p [Rtt^{L ® P)] and Rn^(L ® P) 
has support along the inverse of the section of A corresponding to L. This section 
is everywhere disjoint from the zero section, so the pull back of R^^^, [L ® P) along 
the zero section is trivial: p\R'K^,Oo\ = and since i?7r*0^ = A*i?^7r»C'^ = A*E 
we find —p{g — l)!Ag = 0. 
We put 

Ug :— gcd{p^^ — 1 : p running through the primes > 2g + V\ . 

Note that for a prime £ we have i^\ng if and only if the exponent of i^j&X)* 
divides 1g. By Dirichlet's prime number theorem we have for p > 2 



ordp(ng) 

while 



(p-l)/25 
iTiax{fc:/-i(p-l)|2g} {p-l)\2g, 



ord2(ng) = max{fc : 2'' '^\2g}. 



For example, we have 

ni = 24, n2 = 240, ng = 504, = 480. 
Theorem 9.2. Let tt : A'g — > Ag be the universal family. Then [g — l)\ng\g ~ 0. 
For the proof we consider the commutative diagram 

X'g > Xg 

i i 

J^g t J^g 

where A'g Ag is the degree p^^ — 1 cover obtained by adding a line bundle of 
order p. It follows that [g — l)\p{pi^^ — l)\g vanishes. Then the rest follows from 
the definition of Ug . 

In [SB] Mumford proved that the order of Ai is 12. So our result is off by a 
factor 2. 

In the paper [17] we also gave the vanishing orders for the Chern classes 
of the de Rham bundle T-L\^ for the universal family Xg —J- Ag. This bundle is 
provided with an integrable connection and so its Chern classes are torsion classes 
in integral cohomology. If Z is a prime different from the characteristic these Chern 
classes are torsion too by the comparison theorems and using specialization. We 
denote these classes by ri £ H'^^{Ag,Zi). We determined their orders up to a 
factor 2. Note that r.i vanishes for i odd as y.^^ is a symplectic bundle. 

Theorem 9.3. For all i the class 7'2i+i vanishes. For I < i < g the order of r2i 
in integral (resp. l-adic) cohomology equals (resp. equals the l-part of) ni/2 orui. 
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Wc now turn to the question of a representative cycle in the boundary for Xg 
in CHQ(^g). 

It is a very well-known fact that there is a cusp form A of weight 12 on 
SL(2,Z) and that it has a only one zero, a simple zero at the cusp. This leads to 
the relation 12 Ai = 6, where 6 is the cycle representing the class of the cusp. This 
formula has an analogue for higher g. 

Theorem 9.4. In the Chow group CHQ(^g^-') of codimension g cycles on the 
moduli stack Ag^"^ of rank < 1 degenerations the top Chern class Xg satisfies the 
formula 

Xg = i~irai~2g)Sg, 

with 6g the Q-class of the locus Ag of semi-abelian varieties which are trivial 
extensions of an abelian variety of dimension g—\ by the multiplicative group Gm ■ 

The number C(l — 217) is a rational number —b2g/2g with 629 the 2gth 
Bernoulli number. For example, we have 

12Ai=(5i, 120A2 = 52, 252A3 = (53, 2A0Xi^5i, 132A5 = (5,5 

One might also wish to work on the Satake compactification A*, singular 
though as it is. Every toroidal compactification of Faltings-Chai type Ag has a 
canonical morphism q : Ag — > A*. Then we can define a class £a where a is a 
subset of {1, 2, . . . ,p} by 

= q*{Xa) with Xa equal to A; € G'R^{Ag) 

with d = d{a) = J^iea * t^*^ degree of a and CH^(^*) the Chow homology group. 
Note that this push forward docs not depend on the choice of toroidal compacti- 
fication as such toroidal compactifications always allow a common refinement and 
the A; are compatible with pull back. One can ask for example whether the classes 
of the boundary components A* lie in the Q- vector space generated by the £a with 
d{a) ~ codim^. (^*). In [TH] we made the following conjecture. 

Conjecture 9.5. In the group CII^(^*) with d = g{g + 1) /2 — k{k + 1) /2 we have 

The evidence that Ekedahl and I gave is: 

Theorem 9.6. Conjecture 1 9. 51 is true for fc = 1 and k = 2 and i/char(fc) = p > 
then for all k. 

We shall see later that a multiple of the class Ag has a beautiful representative 
cycle in Ag ® Fp, namely the locus of abelian varieties of p-rank 0. 
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10. Cohomology 



By a result of Borel [9] the stable cohomology of the symplectic group is 
known; this implies that in degrees < g — 2 the cohomology of Sp{2g, Q) (and in 
fact for any finite index subgroup F) is generated by elements in degree 2fc + 4 for 
fe = 0,l,...,(.g-6)/2: 



H*{T, 



The Chern classes X2k+i of the Hodge bundle provide these classes. 

There are also some results on the stable homology of the Satake compacti- 
fication, see [12]; besides the X2k+i there are other classes a2k+i for fc > 1. 

Van der Kallen and Looijenga proved in [17] that the rational homology of 
the pair (^g,^g,doc) with .4g^dec the locus of decomposable principally polarized 
abelian varieties, vanishes in degree < g — 2. 

For low values of g the cohomology of Ag is known. For g = I one has 
H"{Ai,Q) = Q and = = (0). For 5 = 2 one can show that H"{A2,Q) = Q, 



HHA2 



Hain determined the cohomology of ^3. His result ([H]) is: 
Theorem 10.1. The cohomology H*{A3,Q) is given by 

H'{A3,Q)^ Iq{-2) j = 4 
E j = 6 

else 

where E is an extension 

^ Q(-3) E^ Q(-6) ^ 
We find for the compactly supported cohomology a similar result 

(-6) J = 12 



Hi {A3 



Q(-5) i = 10 

Q(-4) J =8 

E' j = 6 

else 



where £" is an extension 0^ E' ^ Q(-3) 0. 

The natural map H* H* is the zero map. Indeed, the classes in Hi for 
i = 12, 10 and 8 are AsAf , AaAf and A3A1, while A3 gives a non-zero class in H^. 
On the other hand, 1, Ai, Ai and Af give non-zero classes in , and . 

Looking at the weight shows that the map is the zero map. 
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By calculating the cohomology of ^3 Hulek and Tommasi proved in that 
the cohomology of the Voronoi compactification for g < 3 coincides with the Chow 
ring (known by the Theorems of Section [71) : 

Theorem 10.2. The cycle class map gives an isomorphism 

CH^(^J-) - H*iA^°^) for g^ 1,2,3. 

11. Siegel Modular Forms 

The cohomology of Ag itself and of the universal family Xg and its powers A"" 
is closely linked to modular forms. We therefore pause to give a short description 
of these modular forms on Sp{2g, Z). For a general reference we refer to the book 
of Freitag [17] and to [M] and the references there. 

Siegel modular forms generalize the notion of usual (elliptic) modular forms 
on SL(2, Z) and its (finite index) subgroups. We first need to generalize the notion 
of the weight of a modular form. To define it we need a finite-dimensional complex 
representation p : Gl(.g, C) — > Gh(V) with V a finite-dimensional complex vector 
space. 

Definition 11.1. A holomorphic map f : Sjg ^ V is called a Siegel modular form 
of weight p if 

/(7(t)) = p(cT + d)/(T) for aU 7 = g Sp(2.g, Z) and all r G ^g, 

plus for g = 1 the extra requirement that / is holomorphic at the cusp. (The 
latter means that / has a Fourier expansion / = X]n>o o,{n)q^ with q = e^'^'^'^ .) 

Modular forms of weight p form a C-vector space Mp(Sp(2g, Z)); as it turns 
out this space is finite-dimensional. This vector space can be identified with the 
space of holomorphic sections of the vector bundle Vp defined before (see Section 
[3]). Since we are working on an orbifold, one has to be careful; we could replace 
Sp(2(7, Z) by a normal congruence subgroup F of finite index that acts freely on S^g, 
take the space Mp{Y) of modular forms on F and consider the invariant subspace 
under the action of Sp(2(7, Z)/F. 

Since we can decompose the representation p into irreducible representa- 
tions it is no restriction of generality to limit ourselves to the case where p is 
irreducible. The irreducible representations p of GL(g,C) are given by g-tuples 
integers (ai, 02, . . . , Cg) with > a.i+i, the highest weight of the representation. 

A special case is where p is given by = /s, in other words 

p(cT + d) ^ det(cr + d)'' . 

In this case the Siegel modular forms are called classical Siegel modular forms of 
weight k. 
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A modular form / has a Fourier expansion 
fir) J2 

n half-integral 

where n runs over the symmetric g y. g matrices that are half-integral (i.e. 2n is 
an integral matrix with even entries along the diagonal) and 

9 

Tr(nr) = ^ ni^T^; + 2 ^ n^jXy . 

A classical result of Koecher (cf. [57]) asserts that a{n) = for n that are not 
semi-positive. This is a sort of Hartogs extension theorem. 

We shall use the suggestive notation for e2iriTr(rir) .^^^ then can write the 
Fourier expansion as 

/(r)= 

n>0, half-integral 

We observe the invariance property 

a{u^nu) = p{u*^)a{n) for all u e GL{g, Z) (1) 
This follows by the short calculation 

a{u*nu) = / /(T)e-2'^*^("'""^)da; 

'J X mod 1 

= p{u*) j /(u™*)e-2'^*'^'(""™')da; = p(w*)a(n), 

J X mod 1 

where we wrote r = .t + iy. 

There is a way to extend Siegel modular forms on Ag to modular forms on 
Ag U Ag-1 and inductively to A*g by means of the so-called <i?-operator of Siegel. 
For / g Mp one defines 

$(/)(r')- iim/(;'°) T'er,,_i. 

The limit is well-defined and gives a function that satisfies 

[^f){i{r'))=pC^'^\)[^!){r'), 

where 7' = {ab;cd) G Sp{2g~2, Z) is embedded in Sp(2g, Z) as the automorphism 
group of the symplectic subspace (ci, fi : i ~ 1, . . . , g — I) . That is, we get a linear 
map 

for some representation p'; in fact, with the representation p' = (01,02, • ■ • ,ag-i) 
for irreducible p = (oi, 02, ... , a^), cf. the proof of 111.41 

Definition 11.2. A Siegel modular form / G Mp is called a cusp form if $(/) = 0. 
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Wc can extend this definition by 



Definition 11.3. A non-zero modular form / e Alp has co-rank k if ^^{f) 7^ 
and = 0. 



That is, / has co-rank k if it survives (non-zero) till Ag-k and no further. 
So cusp forms have co-rank 0. 

For an irreducible representation p of GL^ with highest weight (oi, . . . , a^) 
we define the co-rank as 



Weissauer proved in [72] the following result. 

Theorem 11.4. Let p be irreducible. For a non-zero Siegel modular form f £ Mp 
one has corank(/) < corank(p). 

Proof. We give Weissauer's proof. Suppose that / : f)g — >■ F is a form of co-rank k 
with Fourier series ^ a{n)q^^; then there exists a semi-definite half-integral matrix 
n such that 



such that a{n) 7^ 0. The identity (1) implies that a{n) = p{u)a{n) for all u in the 
group 



This group is a semi-direct product GL^ k N with TV the unipotent radical. The 
important remark now is that the Zariski closure of GL(fc,Z) in Gg^k contains 
SLfe(C) K N and we have a{n) ~ p{u)a{n) for all u € SLfe(C) k N. So the 
Fourier coefficient a{n) lies in the subspace of A'^-invariants. The parabolic 
group P = {(a6;0c?);a G GL„_fc,(i S GL^}, which is also a semi-direct product 
(GL„_fc X GLfc) K A^, acts on via its quotient GL„_fc x GL^. Since this is a 
reductive group decomposes into irreducible representations, each of which is 
a tensor product of an irreducible representation of GL„_fc times an irreducible 
representation of GL^. If t/fc denotes the subgroup of upper triangular unipotent 
matrices in GL(fc, C), then the highest weight space is (y^')^ a-^^^k ^nd this 
equals V^a , and this is 1-dimensional. Thus is an irreducible representation 
of GLg_fc X GLfc and one checks that it is given by (oi, . . . , ag_fc)(8i(ag_fc+i, . . . , Cg). 
The space of invariants 'V'^s,^ q_ t^ylAcx Gg^k can only contain SLfc(C)-invariant 
elements if the GLfc-representation is 1-dimensional. Therefore V'^o^^ is zero unless 
(og-fc+i, . . . , Og) is a 1-dimensional representation, hence ag^k+i = ■ . . = ag. In 
that case the representation for GLg_fc is given by (ai, . . . , a^-fe). Hence the 
Fourier coefficients of / all have to vanish if the corank of / is greater than the 
corank of p. This proves the result. □ 



CO — rank(p) = #{i : 1 < « < ,9, = ag} 




with n' a {g — fc) x (g — k) matrix 
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12. Differential Forms on Ag 

Here wc look first at the moduh space over the field of complex numbers 
Ag{C) = Sp(2g, Z)\f)g. We are interested in differential forms living on Ag. If 
?7 is a holomorphic p form on Ag then wc can pull the form back to f)g. It will 
there be a section of some exterior power of flj-^^ , hence of some exterior power of 
the second symmetric power of the Hodge bundle. Such forms can be analytically 
described by vector-valued Siegel modular forms. 

As we saw in l3.1[ the bundle r2^(log D) is associated to the second symmetric 
power Sym^(E) of the Hodge bundle (at least in the stacky interpretation) and 
we are led to ask which irreducible representations occur in the exterior powers of 
the second symmetric power of the standard representation of GL(g). The answer 
is that these are exactly those irreducible representations p that are of the form 
wr] — 77, where 77 = (p, p — 1, . . . , 1) is half the sum of the positive roots and w 
runs through the 2^ Kostant representatives of W{GLg)\W{Sp2g)j where W is 
the Weyl group. They have the property that they send dominant weights for 
Sp2g to dominant weights for GLg. 

To describe this explicitly, recall that the Weyl group W of Sp(2g, Z) is the 
semi-direct product Sg x (Z/2Z)^ of signed permutations. The Weyl group of GLg 
is equal to the symmetric group Sg. Every left coset Sg\W contains exactly one 
Kostant element w. Such an element w corresponds one to one to an element of 
(Z/2Z)f that we view a g-tuple (ei, . . . , eg) with G {±1} and the action of this 
element w on the root lattice is then via 

(ai, . . . , ag) ^(ecr(l)ao-(l), • ■ • , ^(T{g)0-a{g}) 

for all ai > 02 > ■ ■ ■ > flg and with a the unique permutation such that 

e^(i)a^(i) > ■ ■ • > e<,(g)a^(g). 

If / is a classical Siegel modular form of weight k ~ g + 1 on the group Tg then 
/(r) YiiKj dTij is a top differential on the smooth part of quotient space TgYHg ~ 
Ag{C). It can be extended over the smooth part of the rank-1 compactification 
Ag^'^ if and only if / is a cusp form. It is not difficult to see that this form can be 
extended as a holomorphic form to the whole smooth compactification Ag. 

Proposition 12.1. The map that associates to a classical Siegel modular cusp 
form f G Sg+i{Tg) of weight g + 1 the top differential oj = fir) Y[i<j ^Tij defines 
an isomorphism between Sg+i{Tg) and the space of holomorphic top differentials 
H*^{Ag,^l^'^^^^'^^^) on any smooth compactification Ag. 

Freitag and Pommercning proved in [28j the following extension result. 

Theorem 12.2. Let p < g(g + l)/2 and u) a holomorphic p-form on the smooth 
locus 0/ Sp(2g, Z)\i3g. Then it extends uniquely to a holomorphic p-form on any 
smooth toroidal compactification Ag. 
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But for .9 > 1 the singular focus has codimensfon > 2. This imphes: 

Corollary 12.3. For p < g{g + l)/2 holomorphic p-forms on Ag correspond one- 
one to Sp(2g,'Z) -invariant holomorphic p-forms on f)g: 

When can holomorphic p-forms exist on Ag? Weissauer proved in [72] a 
vanishing theorem of the following form. 

Theorem 12.4. Let Ag be a smooth compactification of Ag. If p is an integer 
< p < .g(.g+l)/2 then the space of holomorphic p-forms on Ag vanishes unless p is 
of the form g{g + l)/2-r{r+l)/2 with 1 < r < g and then H° {Ag , fl''- ) ^ MpiVg) 
with p = (g + 1, . . . , g + 1, g — r, . . . , g — r) with g r occuring r times. 

Weissauer deduced this from the following Vanishing Theorem for Siegel mod- 
ular forms (cf. loc. cit.). 

Theorem 12.5. Let p = (ai, . . . , ag) be irreducible with co — rank(p) < g — Og. If 
we have 

#{1 ^ * ^ 5 : fli = cig + 1} < 2(.g — Og — co-rank(p)) 
then Mp = (0). 

13. The Kodaira Dimension of Ag 

The Kodaira dimension of the moduli space Ag over C, the least integer 
K ~ ^{Ag) such that the sequence Pm/m'^ with Pm{Ag) ~ dim (^g, ilT®™), is 
bounded, is an important invariant. In terms of Siegel modular forms this comes 
down to the growth of the dimension of the space of classical Siegel modular 
forms / of weight k{g -\- 1) that extend to holomorphic tensors f{T)r]'^^ with 
'? ~ /\i<i<j<gdTij on Ag. The first condition is that / vanishes with multiplicity 
> k along the divisor at infinity. Then one has to deal with the extension over 
the quotient singularities. Reid and Tai independently found a criterion for the 
extension of pluri-canonical forms over quotient singularities. 

Proposition 13.1. (Reid-Tai Criterion) A pluri-canonical form rj on C" that is 
invariant under a finite group G acting linearly on C" extends to a resolution of 
singularities if for every non-trivial element 7 £ G and every fixed point x of ^ we 
have 

n 

where the action of 7 on the tangent space of x has eigenvalues e^'^*"^ . // G does 
not possess pseudo-reflections then it extends if and only ifY^^=i '^j — 1- 
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Tai checked (cf. |7^) that if 5 > 5 then every fixed point of a non-trivially 
acting element of Sp(2g,Z) satisfies the requirement of the Reid-Tai criterion and 
thus these forms extend over the quotient singularities of Ag . He also checked that 
the extension over the singularities in the boundary did not present difficulties. 
Thus he showed by calculating the dimension of the space of sections of if®*^ on 
a level cover of Ag and calculating the space over invariants under the action of 
Sp(2(7,Z/£Z) that for g > 9 the space Ag was of general type. He thus improved 
earlier work of Freitag ( |26j ) . 

Mumford extended this result in [60, and proved: 

Theorem 13.2. The moduli space Ag is of general type if g > 7. 

His approach was similar to the method used in his joint paper with Harris 
on the Kodaira dimension of A4g. First he works on the moduli space A[j''^ of rank 
1-degenerations and observes that the Picard group Pic(^g^'') Cg) Q is generated by 
two divisors: Ai and the class i5 of the boundary. By Proposition l3 . 1 1 for the coarse 
moduli space we know the canonical class. 

Proposition 13.3. Let U be the open subset of Ag^"^ of semi-abelian varieties of 
torus rank < 1 with automorphism group {±}. Then the canonical class of U is 
given by {g + l)Ai — S. 

Now there is an explicit effective divisor A^o in Ag^'^ , namely the divisor of 
principally polarized abelian varieties {X, O) that have a singular theta divisor. 
By a tricky calculation in a 1-dimensional family Mumford is able to calculate the 
divisor class of Nq. 

Theorem 13.4. The divisor class of Nq is given by 

- f {g+l)l , \ (.9 + 1)! , 

The divisor Nq is in general not irreducible and splits off the divisor 9q of 
principally polarized abelian varieties whose symmetric theta divisor has a singu- 
larity at a point of order 2. This divisor is given by the vanishing of an even theta 
constant (Nullwert) and so this divisor class can be easily computed. The divisor 
class of 6*0 equals 

[do] = 2^-2(29 + l)Ai -229-5,5. 

Proof (of Theorem [T3:2| We have [Nq] = 6*0 + 2 [R] with R an effective divisor 
given as 

[R] = + ^ - 2-3(29 + 1)) A, - - 2^-^ 

For an expression aXi ~ bS we call the ratio a/b its slope. If R is effective with a 
slope < slope of the expression for the canonical class we know that the canonical 
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class is ample. From the formulas one sees that the slope of A^'o is 6 + 12/(5 + 1) 
and deduces that the inequality holds for g > 7. □ 

From the relatively easy equation for the class [6*0] one deduces that the even 
theta constants provide a divisor with slope 8 + 2'^^^, and this gives that Ag is of 
general type for 5 > 8; cf. p7| . 

For g < 5 we know that Ag is rational or unirational. For g = I and 2 
rationality was known in the 19th century; Katsylo proved rationality for g ~ 3, 
Clemens proved unirationality for .g = 4 and unirationality for g = 5 was proved 
by several people (Mori-Mukai, Donagi, Verra). But the ease g = 6 is still open. 

For some results on the nef cone we refer to the survey [35] of Grushevsky. 

14. Stratifications 

In positive characteristic the moduli space Ag ^ Fp possesses stratifications 
that can tell us quite a lot about the moduli space; it is not clear what the 
characteristic zero analogues of these stratifications are. This makes this moduli 
space in some sense more accessible in characteristic p than in characteristic zero, 
a fact that may sound counterintuitive to many. 

The stratifications we are refering to are the Ekedahl-Oort stratification and 
the Newton polygon stratification. Since the cycle classes are not known for the 
latter one we shall stick to the Ekedahl-Oort stratification, E-0 for short. It was 
originally defined by Ekedahl and Oort in terms of the group scheme X[p], the 
kernel of multiplication by p for an abelian variety in characteristic p. It has been 
studied intensively by Oort and many others, see e.g. |M] and [55] . 

The alternative definition using degeneracy loci of vector bundles was given 
in my paper [32j and worked out fully in joint work with Ekedahl, see [19] . In 
this section we shall write Ag for Ag OFp. We start with the universal principally 
polarized abelian variety tt : A'g — > Ag. For an abelian variey X over a field 
k the de Rham cohomology H^j^{X) is a vector space of rank 2g. We get by 
doing this in families a cohomology sheaf T~l-dn{^g / ^g) ^ the hyperdirect image 
R^n^:{Oxg — >■ I A )■ Because of the polarization it comes with a symplectic 
pairing ( , ) : x ^ ^Ag- We have the Hodge filtration of Hj^: 

^ T^Mx^iA,) -> ^dR ^ B'^^Ox, ^ 0, 

where the first non-zero term is the Hodge bundle Eg. In characteristic p > we 
have additionally two maps 

F:Xg^X^^\ V:X^P^-^Xg, 

relative Frobenius and the Verschiebung satisfying F oV ~ p ■ id^{p) and V o F — 
P ■ idA', • 

Look at the simplest case g = I. Since Frobenius is inseparable the kernel 
X[p] of multiplication by p is not reduced and has either 1 or p physical points. 
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An eUiptic curve in characteristic p > is cahed supersingular if and only if 
^[p]icd = (0). Equivalently this means that V is also inseparable, hence the 
kernel of F and V (for Xg instead of x'jf^) coincide. There are finitely many 
points on the j-line Ai that correspond to the supersingular elliptic curves. 

So in general we will compare the relative position of the kernel of F and 
of V inside "H^j^. As it turns out, it is better to work with the flag space Fg 
of symplectic flags on "H^j^; by this we mean that we consider the space of flags 
i.^ifi'Li on T^ds. t'^^t rank(i?i) = i, Eg = and Eg_i = Ej-. We can then 
introduce a second flag on 'H\y{.^ i^i)'i=i defined by setting 
Dg = ker(F) = y-i(O), Dg+, = V'\e\^\ 
and complementing by 

Dg~i = D^^.^ for i = 

This is called the conjugate flag. For an abelian variety X we deflne the canonical 
flag of X as the coarsest flag that is stable under F: if G is a member, then also 
FlG^P^)] usually this will not be a full flag. The conjugate flag is a refinement 
of the canonical flag. 

So starting with one flltration we end up with two flltrations. We then 
compare these two flltrations. In order to do this we need the Weyl group Wg 
of the symplectic group Sp(2(7,Z). This group is isomorphic to the semi-direct 
product 

Wg^SgtK (Z/2Z)9 = {ae S2g : cr{i) + a{2g + 1 - i) ^ 2g + 1, i ^ 1, . . . , g} . 

As is well-known each element w G Wg has a length £{w). Let 

W:g = {aeWg: a{l, 2, . . . , g} = {1, 2, . . . = Sg . 

Now for every coset aWg there is a unique element w of minimal length in aWg 
such that every w' € aWg can be written as w' = wx with £{w') = i{w) + i{x). 
There is a partial order on Wg, the Bruhat-Chevallcy order: 

wi > W2 if and only if rwi{i,j) < f'w2ihj) for all 

where the function r.u,{i,j) is deflned as 

rw{i,j) = #{n < i : w{n) < j}. 

There are 2^ so-called final elements in Wg : these are the minimal elements of the 
cosets. In another context (see Section fT^ these are called Kostant representatives. 
An element a £ Wg is flnal if and only if a{i) < a{j) for i < j < g. These 
final elements correspond one-to-one to so-called final types: these are increasing 
surjective maps 

z/:{0,l,...,2g}-^{0,l,...,25} 

satisfying i'{2g — i) = vli) + {g — i) for < i < g. The bijection is gotten by 
associating to w e Wg the final type with Vwii) — i — fj^^g^i). 
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Now the stratification on our flag space J-g is defined by 

{E.,D.) e [/„, ^ dim(S, n Dj) > r.^[i,j) . 

There is also a scheme-theoretic definition: the two filtrations mean that we have 
two sections of a G/B-bundlc T (with structure group G) over the base with 
G ~ Sp2g and B a Borel subgroup; locally (in the etale topology) we may assume 
that f is a trivializing section; then we can view s as a map of the base to G/ B 
and we simply take Uw (resp. Uw) to be the inverse image of the i?-orbit BwB 
(resp. its closure). This definition is independent of the chosen trivialization. We 
thus find global subschemes Uw and Uw for the 2^(5!) elements of Wg. 

It will turn out that for final elements the projection map J-g — > Ag restricted 
to Uw defines a finite morphism to its image in Ag, and these will be the E-0 strata. 
But the strata on J-g behave in a much better way. That is why we first study these 
on Fg. We can extend the strata to strata over a compactification, see [12]: the 
Hodge bundle extends and so does the de Rham sheaf, namely as the logarithmic 
de Rham sheaf R^it^{^1'- - ) and then we play the same game as above. 

There is a smallest stratum: Ui associated to the identity element of Wg . 

Proposition 14.1. Any irreducible component of any Uw in J^g contains a point 
ofUi. 

The advantage of working in the flag space comes out clearly if we consider 
the local structure of our strata. The idea is that locally our moduli space (flag 
space) looks like the space FLg of complete symplectic flags in a 25-dimensional 
symplective space. 

We need the notion of height 1 maps in charactistic p > 0. A closed immersion 
S* 5' is called a height 1 map if /(P) = (0) with / the ideal sheaf deflning S 
and /^P) the ideal generated by p-th powers of elements. If 5 = Spec(i?) and 
X : Spec(fc) — > S* is a closed point then the height 1 neighborhood is Spec(i?/m^^^). 
We can then introduce the notions of height 1 isomorphic and height 1 smooth in 
an obvious way. 

Our basic result of [H] about our strata is now: 

Theorem 14.2. Let k be a perfect field. For every k-point x of Fg there exists a 
k-point 0/ FLg such that their height 1 neighborhoods are isomorphic as stratified 
spaces. 

Here the stratification on the fiag space FLg is the usual one given by the 
Schubert cells. The idea of the proof is to trivialize the de Rham bundle over a 
height 1 neighborhood and then use infinitesimal Torelli for abelian varieties. Our 
theorem has some immediate consequences. 

Corollary 14.3. (1) Each stratum Uw is smooth of dimension £{w). 
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(2) Each stratum is Cohen- Macaulay, reduced and normal; moreover Uw 
is the closure of Uw . 

(3) For w a final element the projection Tg — ^ Ag induces a finite Stale map 
Uw Vw , with the image of ■ 

We now descend from Fg to Ag to define the Ekedahl-Oort stratification. 

Definition 14.4. For a final element w £ Wg the E-0 stratum K„ is defined to 
be the image of Uw under the projection J-g — > Ag . 

Over a E-0 stratum Vu, C Ag the type of the canonical filtration (i.e., the 
dimensions of the filtration steps that occur) are constant. 

Proposition 14.5. The image of any Uw under the projection Tg — > Ag is a 
union of strata Vy ; the image of any Uw is a union of strata Vy . 

We also have an irreducibility result (cf. [19]). Each final element w G Wg 
corresponds to a partition and a Young diagram. 

Theorem 14.6. If w ^ Wg is a final element whose Young diagram Y does not 
contain all rows of length i with \{g + l)/2] < i < g then Vw is irreducible and 
Uw Vw is a connected Stale cover. 

Harashita proved in [lU] that the other ones are in general reducible (with 
exceptions maybe for small characteristics). 

A stratification on a space is not worth much unless one knows the cycle 
classes of the strata. In our case one can calculate these. 

On the flag space the Chcrn classes Xi of the Hodge bundle decompose in 
their roots: 

ci{Ei) = li + ... + li. 

Wc then have 

Cl{Dg + i) - Cl{Dg + l^i) ^Pk. 

Theorem 14.7. The cycle classes of Uw are polynomials in the classes U with 
coefficients that are polynomials in p. 

We refer to [12] for an explicit formula. Using the analogues of the maps tt^ 
of Section [2] and Lemma 12.41 we can calculate the cycle classes of the E-0 strata 

on Ag. 

Instead of giving a general formula we restrict to giving the formulas for some 
important strata. For example, there are the p-rank strata 

Vf:={[X]eAg:#X[p]{k)<pf} 

for / = (7, (yi — 1, . . . , 0. Besides these there are the a-number strata 

Ta := {[X] e Ag : dimfe Hom(ap, X) > a} . 
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Recall that the p-rank f{X) of an abelian variety is / if and only if ^X[p]{k) = p-^ 
and < f < g with f = g being the generic case. Similarly, the a-number of a{X) 
of X is dinifc(ap, X) and this equals the rank of kei{V) n ker(F); so < a{X) < g 
with a{X) = being the generic case. The stratum Vf has codimension g — f while 
the stratum Ta has codimension a (a + l)/2. These codimensions were originally 
calculated by Oort and follow here easily from 114.51 

Theorem 14.8. The cycle class of the p-rank stratum Vf is given by 
[y/] = (p-l)(p2_i)...(p9-/_i)A,_/. 

For example, for g = 1 the stratum Vq is the stratum of supersingular elliptic 
curves. We have [Vq] = {p — l)Ai. By the cycle relation 12Ai = S with 6 the cycle 
of the boundary we find 

Since the degenerate elliptic curve (rational nodal curve) has two automorphisms 
we find (using the stacky interpretation of our formula) the Deuring Mass Formula 

1 1 



E 



#Autfc(i?) 24 

i///c supersingular 

for the number of supersingular elliptic curves in characteristic p. One may view all 
the formulas for the cycle classes as a generalization of the Deuring Mass Formula. 
The formulas for the a-number strata are given in [32] and [19]. We have 

Theorem 14.9. The cycle class of the locus Ta of abelian varieties with a-number 
> a is given by 

^g^(E(p).g,(,)_^(E^), 

where Qf^^ is defined as in Section\^ and the sum is over all partitions j3 contained 
in g{a) ~ {a, a — 1, . . . , 1}. 

For example, the formula for the stratum Ti is pXi — Ai, which fits since 
a-number > 1 means exactly that the p-rank is < g — 1. For a = 2 the formula is 
[72] = {p- 1)(P^ + l)(AiA2) - {p^ - 1)2X3. For a^g the formula reads 

[T,] = (p - l)(p2 + 1) . . . (p9 + (-l)9)AiA2 • • • A,. 

This stratum is of maximal codimension; this formula is visibly a generalization of 
the Deuring Mass Formula and counts the number of superspecial abelian varieties; 
this number was first calculated by Ekedahl in |16j . 

We formulate a corollary of our formulas for the p-rank strata. 



Corollary 14.10. The Chern classes Ai of the Hodge bundle are represented by 
effective Q-classes. 
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Another nice aspect of our formulas is that when we speciahze p = in 
our formulas, that are polynomials in the li and Xi with coefficients that are 
polynomials in p, we get back the formulas for the cycle classes of the Schubert 
cells both on the Grassmannian and the flag space, see 

15. Complete subvarieties of Ag 

The existence of complete subvarieties of relative small codimension can give 
us interesting information about a non-complete variety. In the case of the moduli 
space Ag ^ k (for some field k) we know that Ai is an ample class and that 
^9(9 i)/2+i vanishes. Since for a complete subvariety X of dimension d we must 
have Xf\X ^ 0, this implies immediately a lower bound on the codimension. 

Theorem 15.1. The minimum possible codimension of a complete subvariety of 
Ag ®kisg. 

This lower bound can be realized in positive characteristic as was noted by 
Koblitz and Oort, see [H], [SI]- The idea is simple: a semi-abelian variety with a 
positive torus rank has points of order p. So by requiring that our abelian varieties 
have p-rank we stay inside Ag and this defines the required complete variety. 

Theorem 15.2. The moduli stack Ag®k with char(fc) ~ p > Q contains a complete 
substack of codimension g: the locus Vq of abelian varieties with p-rank zero. 

A generalization is: 

Theorem 15.3. The partial Satake compactification A* — A*_f^^^y^ in charac- 
teristic p > of degenerations of torus rank t contains a complete subvariety of 
codimension g — t, namely the locus Vt of p-rank < t. 

In characteristic there is no such obvious complete subvariety of codimen- 
sion g, at least if 5 > 3. Oort conjectured in [63] that it should not exist for g > 3. 
This was proved by Keel and Sadun in |48j . 

Theorem 15.4. If X d Ag{C) is a complete subvariety with the property that 
Xi\X is trivial in cohomology for some 1 < i < 5 then dimX < i{i — l)/2 with 
strict inequality if i > 3. 

This theorem implies the following corollary. 

Corollary 15.5. For g > 3 the moduli space (X) C does not possess a complete 
subvariety of codimension g. 

So the question arises what the maximum dimension of a complete subvariety 
of y^g(C) is. 

One might conclude that the analogue of Ag(C) in positive characteristic 
in some sense is rather the locus of principally polarized abelian varieties with 
maximal p-rank (= g) than Ag (8) Fp. 
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16. Cohomology of local systems and relations to modular forms 

There is a close connection between the cohomology of moduli spaces of 
abelian varieties and modular forms. This connection was discovered in the 19th 
century and developed further in the work of Eichler, Shimura, Kuga, Matsushima 
and many others. It has developed into a central theme involving the theory of 
automorphic representations and the Langlands philosophy. We shall restrict here 
to just one aspect of this. This is work in progress that is being developed in joint 
work with Jonas Bergstrom and Carel Faber. 

Let us start with g = 1- The space of cusp forms S2k of weight 2k on SL(2, Z) 
has a cohomological interpretation. To describe it we consider the universal elliptic 
curve TT : A'l — > ^1 and let V := i?^7r*Q be the local system of rank 2 with as fibre 
over [X] the cohomology {X, Q) of the elliptic curve X 

From V we can construct other local systems: define for a > 1 

Va Sym'^Cl/). 

This is a local system of rank a+1. There is also the Z-adic analogue T^^'-* = i?^7r*Q/ 
for Z-adic etale cohomology and its variants V'i'''. The basic result of Eichler and 
Shimura says that for a > and a even there is an isomorphism 

Hi (Al ® C, K ® C) = Sa+2 © Sa+2 © C. 

So we might say that as a mixed Hodge module the compactly supported coho- 
mology of the local system Va(^C equals Sa+2 © Sa+2 © C 

But this identity can be stretched further. The left hand side may be replaced 
by other flavors of cohomology, for example by Z-adic etale cohomology H^{Ai ^ 
Q,K^'^) that comes with a natural Galois action of Gal(Q/Q). In view of this, we 
replace the left hand side by an Euler characteristic 

2 

edAuVa) ■.= Y,iHl{Ai,Va)], 

1=0 

where now the cohomomology groups of compactly supported cohomology are to be 
interpreted in an appropriate Grothendieck group, e.g. of mixed Hodge structures 
when we consider complex cohomology H*{Ai (g) C, 14 <8 C) with its mixed Hodge 
structure, or in the Grothendieck group of Galois representations when we consider 
compactly supported etale /-adic cohomology if*g((^i (g) Q,Va^). On the other 
hand, for the right hand side SchoU defined in [67] a Chow motive S[2k] associated 
to the space of cusp forms S2k for fc > 1. Then a sophisticated form of the 
Eichler-Shimura isomorphism asserts that we have an isomorphism 

eciAi,Va)^-S[a + 2]-l a>2cven. 

We have a natural algebra of operators, the Hecke operators, acting on the 
spaces of cusp forms, but also on the cohomology since the Hecke operators are 
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defined by correspondences. Then the isomorphism above is compatible with the 
action of the Hecke operators. 

But our moduh space Ai is defined over Z. We thus can study the cohomology 
over Q by looking at the fibres Ai ^ ¥p and the corresponding local systems 
vi'^ (81 Fp (for Z 7^ p) by using comparison theorems. Now in characteristic p 
the Hecke operator is defined by the correspondence Xq{p) of (cyclic) p-isogcnies 
: X — > X' between elliptic curves (i.e. we require deg4> = p); it allows maps 
Qi : Xo{p) Ai {i = 1,2) by sending to its source X and target X'. In 
characteristic p the correspondence decomposes into two components 

Xo (p) ® Fp ~ Fp + Fp, (the congruence relation) 

where Fp is the correspondence X X^^' and Fp its transpose. This follows since 
for such a p-isogeny we have that X' = X'^"^ or X = (X')^^'' . This implies a relation 
between the Hecke operator T{p) and the action of Frobenius on {Ai<SSi¥p, vi^-*); 
The result is then a relation between the action of Frobenius on etale cohomology 
and the action of a Hecke operator on the space of cusp forms ([2], Prop. 4.8) 

Tr(^;„ HliAi ® Fp, Va)) = Tr(r(p), 5a+2) + 1 • 

We can calculate the traces of the Frobenii by counting points over finite fields. In 
fact, if we make a list of all elliptic curves over Fp up to isomorphism over Fp and we 
calculate the eigenvalues ax, ctx of Fp acting on the etale cohomology H^{X, Q;) 
then we can calculate the trace of Fp on the cohomology H}.(Ai ® Fp, Va^^) by 
summing the expression 

«x + a^x^ax + ... + ax 
#AutF^(X) 

over all X in our list. So by counting elliptic curves over a finite field Fp we can 
calculate the trace of the Hecke operator T{p) on Sa+2] in fact, once we have our 
list of elliptic curves over Fp together with the eigenvalues ax , ax and the order 
of their automorphism group, we can calculate the trace of T{p) on the space of 
cusp forms 6*0+2 for all a. 

The term —1 in the Eichler-Shimura identity can be interpreted as coming 
from the kernel 

-1 = J2{-iy[keTHl{AuVa) ^ H\Ai,Va)]. 

So to avoid this little nuisance we might replace the compactly supported coho- 
mology by the image of compactly supported cohomology in the usual cohomology, 
i.e. define the interior cohomology Hf as the image of compactly supported coho- 
mology in the usual cohomology. Then the result reads 

e\{Ai,Va) ^ -S[a + 2] for a > 2 even. 

Some words about the history of the Eichler-Shimura result may be in order 
here. Around 1954 Eichler showed (see [T3|) that for some congruence subgroup 



Gerard van der Geer 



35 



r of SL(2,Z) the p-part of the zcta function of the corresponding modular curve 
X-p in characteristic p is given by the Hecke polynomial for the Hecke operator 
T{p) acting on the space of cusp forms of weight 2 for F. This was generalized to 
some other groups by Shimura. M. Sato observed in 1962 that by combining the 
Eichler-Selberg trace formula for modular forms with the congruence relation (ex- 
pressing the Hecke correspondence in terms of the Frobenius correspondence and 
its transpose) one could extend Eichler's results by expressing the Hecke poly- 
nomials in terms of the zeta functions of Mi^n <8i Vp, except for problems due 
to the non-completeness of the moduli spaces. A little later Kuga and Shimura 
showed that Sato's idea worked for compact quotients of the upper half plane 
(parametrizing abelian surfaces). Ihara then made Sato's idea reality in 1967 by 
combining the Eichler-Selberg trace formula with results of Deuring and Hasse 
on zeta functions of elliptic curves, cf. [15], where one also finds references to the 
history of this problem. A year later Deligne solved in [Tl] the problems posed by 
the non-completeness of the moduli spaces. Finally Scholl proved the existence of 
the motive S[k] for even k in 1990. A different construction of this motive was 
given by Consani and Faber in fl3| . 

That the approach sketched above for calculating traces of Hecke operators 
by counting over finite fields is not used commonly, is due to the fact that we 
have an explicit formula for the traces of the Hecke operators, the Eichler-Selberg 
trace formula, cf. [74]. But for higher genus g, i.e. for modular forms on the 
symplectic group Sp(2g, Z) with g > 2, no analogue of the trace formula for Siegel 
modular forms is known. Moreover, a closer inspection reveals that vector-valued 
Siegel modular forms are the good analogue for higher g of the modular forms on 
SL(2,Z) (rather than classical Siegel modular forms only). This suggests to try 
the analogue of the point counting method for genus 2 and higher. That is what 
Carel Faber and I did for Sp(4, Z) and in joint work with Bergstrom extended to 
genus 2 and level 2 and also to genus 3, see [HI [HI [Z]- 

There are alternative methods that we should point out. In general one 
tries to compare a trace formula of Selberg type (Arthur trace formula) with the 
Grothendieck-Lcfschctz fixed point formula. There is a topological trace formula 
for the trace of Hecke operators acting on the compactly supported cohomology, 
see for example [H], esp. the letter to Goresky and MacPherson there. Laumon 
gives a spectral decomposition of the cohomology of local systems for g ~ 2 (for 
the trivial one in jSlj and in general in [52]); cf. also the work of Kottwitz in 
general. We also refer to Sophie Morel's book [54]. But though these methods in 
principle could lead to explicit results on Siegel modular forms, as far as I know 
it has not yet done that. 

So start with the universal principally polarized abelian variety tt : A'g — >■ Ag 
and form the local system V := i?^7r*Q and its ^-adic counterpart i?^7r*Q/ for etale 
cohomology. By abuse of notation we will write simply V . We consider tt as a 
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morphism of stacks. For any irreducible representation A of Sp2g wc can construct 
a corresponding local system V\; it is obtained by applying a Schur functor, cf. e.g. 
[30] . So if we denote A by its highest weight Ai > A2 > • • • > Ag then V ~ T4,o,...,o 
and Sym'^(y) = Va,o....,o. 
We now consider 

i 

where as before the brackets indicate that we consider this in the Grothendieck 
group of the appropriate category (mixed Hodge modules, Galois representations). 
It is a basic result of Faltings that W{Ag'»C, Vx(g)C) and F*(y^g(g)C, Vx(g)C) 

carry a mixed Hodge structure. Moreover, the interior cohomology HI carries a 
pure Hodge structure with the weights equal to the 2^ sums of any of the subsets 
of {Ai + .g, A2 + .g — 1, . . . , Ag + 1}. He also shows that for regular A, that is, when 
Ai > A2 • • • > Ag > 0, the cohomology Hf vanishes when i 7^ g{g + l)/2. 

These results of Faltings are the analogue for the non-compact case of results 
of Matsushima and Murakami in [S^; they could use Hodge theory to deduce 
the vanishing of cohomology groups and the decompositions indexed by pairs of 
elements in the Weyl group. 

For g = 2 a local system Vx is specified by giving A = (a, b) with a > 5 > 0. 
Then the Hodge filtration is 

pa+b+3 ^ pa+2 ^ pb+1 ^ pO ^ H? {A2 <»C,Vx® C). 

Moreover, there is an identification of the first step in the Hodge filtration 

pa+6+3 ^ c 

= t>a~b,b+3, 

with the space Sa-b.b+3 of Siegel modular cusp forms whose weight p is the repre- 
sentation Sym°~''St (g) det(St)''+^ with St the standard representation of GL(2, C). 

Again, as for p = 1, we have an algebra of Hecke operators induced by 
geometric correspondences and it acts both on the cohomology and the modular 
forms compatible with the isomorphism. 

Given our general ignorance of vector-valued Siegel modular forms for > 1 
the obvious question at this point is whether we can mimic the approach sketched 
above for calculating the traces of the Hecke operators by counting over finite 
fields. 

Note that by Torelli we have morphism M2 ^ A2 = , where is the 
moduli space of curves of genus 2 of compact type. This means that we have to 
include besides the smooth curves of genus 2 the stable curves of genus 2 that are 
a union of two elliptic curves. 

Can we use this to calculate the traces of the Hecke operator T{p) on the 
spaces of vector- valued Siegel modular forms? 
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Two problems arise. The first is the so-called Eisenstein cohoniology. This is 



eEis(^2,K,b) V(-l)*(kerH^ ^ i/')(^2,K, 



b) 



In the case of genus 1 this expression was equal to the innocent —1, but for higher 
g this is a more complicated term. The second problem is the endoscopy: the 
terms in the Hodge filtration that do not see the first and last step of the Hodge 
filtration. For torsion- free groups there is work by Schwermer (see |68] ) on the 
Eisenstein cohomology; cf. also the work of Harder [IT] . And there is an extensive 
literature on endoscopy. But explicit formulas were not available. 

On the basis of numerical calculations Carel Faber and I guessed in [22] a 
formula for the Eisenstein cohomology I was able to prove this formula in [35) for 
regular A. We also made a guess for the endoscopic term. Putting this together 
we get the following conjectural formula for (a, b) ^ (0, 0). 

Conjecture 16.1. The trace oj the Hecke operator T{p) on the space Sa^b,b+3 of 
cusp forms on Sp(4, Z) equals 

-Tr(Fp, ec{A2 ® ¥p, T4,b)) + Tr(Fp, e2,extra(a, b)), 

where the term e2.oxtra(a5 b) is defined as 



Sa-b+2 - Sa+b+iiS[a - b + 2] + 1%"+' + 



S[b + 2] + l a even, 
—S[a + 3] a odd, 



and s„ = dim 5„(SL(2, Z)) is the dimension of the space of cusp forms on SL(2, Z) 
and L = h'^{¥^) is the Lefschetz motive. 

li a>b = 01 a = b>0 then one should put S2 = ^1 and 5 [2] = —1 — L in 
the formula. 

In the case of regular local systems (i.e. a > 6 > 0) our conjecture can be 
deduced from results of Weissauer as he shows in his preprint [73] . In the case of 
local system of non-regular highest weight the conjecture is still open. 

We have counted the curves of genus 2 of compact type for all primes p < 37. 
This implies that we can calculate the traces of the Hecke operator T{p) for p < 37 
on the space of cusp forms Sa-b,b+3 for all a > b > 0, and assuming the conjecture 
also for a > 6 = and a = b > 0. 

Our results are in accordance with results on the numerical Euler characteris- 
tic dim_ff*(^2, Va.b) due to Getzler ([3^) and with the dimension formula 
for the space of cusp form Sa-b,b+3 due to Tsushima (|71)). 

We give an example. For (a, b) = (11, 5) we have 

ec(^2, 1^11,5) = -L^-5[6, 8] 

with ^[GjS] the hypothetical motive associated to the (1-dimensional) space of 
cusp forms 5*6,8 • We list a few eigenvalues X{p) and A(p^) of the Hecke operators. 



38 



The Cohomology of the Moduh Space of Abehan Varieties 



This allows us to give the characteristic polynomial of Frobcnius (and the Euler 
factor of the spinor i-function of the Siegel modular form) 

1 - Xip)X + (A(p)2 - A(p2) - p<'+''+^)X^ - Xip)p''+''+^X^ + p2(a+&+3)^4 

and its slopes. 



p 


A(P) 




slopes 


2 





-57344 


13/2,25/2 


3 


-27000 


143765361 


3,7,12,16 


5 


2843100 


-7734928874375 


2,7,12,17 


7 


-107822000 


4057621173384801 


0,6,13,19 



Another indication that the computer counts of curves of genus 2 are correct 
comes from a conjecture of Harder about congruences between Heckc eigenvalues of 
cusp forms for genus 1 and genus 2. Harder had the idea that there should be such 
congruences many years ago (cf. HI]), but our results motivated him to make his 
conjecture precise and explicit. He conjectured that if a (not too small, or better 
an ordinary) prime £ divides a critical value s of the L-function of an eigenform 
on SL(2,Z) of weight r then there should be a vector-valued Siegel modular form 
of prescribed weight depending on s and r and a congruence modulo £ between 
the eigenvalues under the Hecke operator T{p) for / and F. We refer to [TT], the 
papers by Harder |42j and van der Geer |34| there, for an account of this fascinating 
story. These congruences generalize the famous congruence 

T{n) + 1 (mod 691) 

for the Hecke eigenvalues t{p) {p a prime) of the modular form A = X]ri>o ''"('^)'J'" 
of weight 12 on SL(2, Z). One example of such a congruence is the congruence 

\{p) = / + a{p) + p^^ (mod 41) 

where / = '^a{n)q^ is the normalized (a(l) = 1) cusp form of weight 22 on 
SL(2,Z) and the \{p) are the Hecke eigenvalues of the genus 2 Siegel cusp form 
F e 54,10. We checked this congruence for all primes p with p < 37. For example, 
a(37) = 22191429912035222 and A(37) = 11555498201265580. 

In joint work with Bergstrom and Faber we extended this to level 2. One 
considers the moduli space A2 [2] of principally polarized abelian surfaces of level 2. 
This moduli space contains as a dense open subset the moduli space Al2['w^] of 
curves of genus 2 together with six Weierstrass points. It comes with an action 
of 5*6 = Sp(4, Z/2Z). We formulated an analogue of conjecture 116.11 for level 2. 
Assuming this conjecture we can calculate the traces of the Hecke operators T{p) 
for p < 37 for the spaces of cusp forms of all level 2. Using these numerical data we 
could observe lifings from genus 1 to genus 2 and could make precise conjectures 
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about such liftings; and again wc could predict and verify numerically congruences 
between genus 1 and genus 2 eigenforms. 

We give an example. For (a, b) = (4, 2) we find 

ecM2[2], ^4.2) - + 45 - ^pap], (2, 5)] 

and assuming our conjecture we can calculate the traces of the Hecke operators on 
the space of cusp forms of weight (2, 5) on the level 2 congruence subgroup T2[2] 
of Sp(4, Z); this space is a representation of type [2^, 1^] for the symmetric group 
5*6 and is generated by one Siegel modular form; for this Siegel modular form we 
have the eigenvalue A(23) = -323440 for T(23). 

It is natural to ask how the story continues for genus 3. The first remark 
is that the Torelli map Ai^ — > ^3 is a morphism of degree 2 in the sense of 
stacks. This is due to the fact that every principally polarized abelian variety has 
a non-trivial automorphism —id, while the general curve of genus 3 has a trivial 
automorphism group. This has as a consequence that for local systems Va,b,c with 
a + b + c odd the cohomology on ^3 vanishes, but on A4i, it need not; and in fact 
in general it does not. 

In joint work with Bergstrom and Faber we managed to formulate an analogue 
of ll6.1l for genus 3, see [7]. Assuming the conjecture we are able to calculate the 
traces of Hecke operators T{p) on the space of cusp forms Sa~b,b~c.c+4: for all 
primes p for which we did the counting (at least p < 19). Again the numerically 
data fit with calculations of dimensions of spaces of cusp forms and numerical 
Euler characteristics. (These numerical Euler characteristics were calculated in 
[5].) And again we could observe congruences between eigenvalues for T{p) for 
(7 = 3 eigenforms and those of genus 1 and 2. We give two examples: 

ec(^3, "t^io,4,o) = -L" + L + S[6, 8], 

the same 5[6,8] for genus 2 we met above. And for example 

edAs, Vsaa) = -5'[12] + S'[12] + S[4, 0, 8], 

where genuine Siegel modular forms (of weight (4, 0, 8)) of genus 3 do occurr. We 
refer to [7| for the details and to the Chapter by Faber and Pandharipande for the 
cohomology of local systems and modular forms on the moduli spaces of curves. 
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